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The Austin Independent School District's Research and 
Evaluation Office presents practical information concerning 
observational research. This paper focuses on five topics: (1) what 
makes a good observer (setting the ground rules, training observers 
in details, and practice, i.e., involving the observers in planning 
and providing rigorous training); (2) frequent teacher reactions 
encountered (hostility, apprehension, apathy) and suggestions for 
dealing with the reactions; (3) frequent student reactions 
encountered (curiosity, showing-of f ) and ways to deal with the 
situations; (4) school facilities or the lack of them and 
counteracting these problems by planning ahead; and (5) constructing 
observation instruments designed to answer specific questions, 
tailored to the age level of the student, and easy to use. A 
bibliography containing a number of reports dealing with 
observational findings is included. (PN) 
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Practical Hints for Observational Research 



Wanda Washington, 3.S. 
Karen Banks Carsrud, Ph.D. 
Freda M. Holley, Ph.D. 
Perry Sailor, A.B. 

Austin Independent School District, Austin, Texas 

Over the course of the last six years, persons from Austin I.S.D.'s research 
and evaluation office spent over 6,900 hours observing approximately 1,100 
elementary students from their first minute of school in the morning to their 
last minute in the afternooa. Our goals in doing this research have always been 
to collect reliable, uneful data without unduly disrupting the behavior- of the 
teachers and students who are observed. This paper is intended to share some 
practical expertise we have gained in doing such observational research. 

This paper will focus on the following topics: 

• What Makes a Good Observer? 

• Frequent Teacher Reactions Encountered 
and Sow to Deal With Them 

• Frequent Student Reactions Encountered 
and How to Deal With Them 

o School Facilities (or the lack of Them!) 

• Designing Observation Instruments 

. What Makes a Good Observer? 

All observers who participated in this research have bachelor's degrees. They 
a?e not required to have teacher certification, but classroom experience is 
considered useful. A degree in a research-related field can also be quite 
bslpful. It is most important to note, however, that observers (whether 
para-professionals or professionals) do a better job when given insight into 
the reasons and goals for the job, the expected outcomes of the project, the 
rules and regulations, and the opportunity for input. Training is also 
required to help observers in answering questions, behaving appropriately when 
in the schools, being consistent in coding schemes, reliability checks, etc. 
To sum it up, involving the observers in planning and providing rigorous 
training are helpful in iasuring you have a good observer. 

First Stage of Training: Setting the Ground Rules. 



There are at least three stages of training that an observer will probably need 
before going out into the schools to do observations. First, some preliminary, 



but crucial, concepts to review: 



• What information can be shared with persons not conducting 
the research? If the hypotheses of the study are revealed 
to teachers or students, for example, it may affect their 
behavior in the classroom* Observers should be told what 
information they can share and what they cannot . Our typical 
answer is usually, "I am not sure I know what you are talking 
about, but I will take your question back to the office and 
give it to the proper supervisor • 11 (Write down the question,) 
Observers should probably check back with their supervisor to 
see if he or she has found time to respond, 

• Wear appropriate dress for the public schools. Men should 
wear casual slacks and shirt, dress pants or suits. No muscle 
shirts or faded blue jeans* Our male observers wore ties, even 
though they were not mandatory* 

Females should wear a dress, skirt and blouse or tailored pants 
and blouse* They should not wear see-through blouses or blue 
jeans* We found pants to be more practical dress because of the 
small dimensions of the elementary schools' furniture*. 

• To ensure collection of reliable, useful data, observers must be 
able to understand the observation instrument and use it with 

ease and familiarity. They should spend as many hours as possible , 
practicing witli the instrument* We will discuss suggested practice 
techniques in later paragraphs* 
i 

• Observers should be aware that ethnic identification or sympathetic 
involvement with specific children can hinder efforts to collect 
reliable, useful data* 

Second Sta ge - Training Observers in Details * 

Based on schools 1 reponses to The Observation Reaction Form* over a period of 
several years, the following rules have become staples of our training 
sess ions : 

• Know the route to the school at which you are scheduled 
for observation* 

• Know the school's telephone number in case of an unforeseen 
delay or problem encountered enroute to the school* 

• Record or memorize, the names of the following people in the 
school in which you are scheduled to observe: principal, 
secretary, and teacher whose class you will observe in* 

^lobservatiba Reaction Form contains three Likert scale items dealing with 
1) convenience of the observation, 2) typicality of the observation day, 
and 3) obstrusiveness/nonobtrusiveness of the observer. 
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• If the school district furnishes identification badges to their 
employees, be sure to wear it. 

• Checks into the school's office as soon as you enter the 
school. Explain the reason for being there and ask for 
directions to the classroom where the scheduled observation 
will occur! and to the teacher's lounge and restroom 
facilities. 

Also ask the secretary if there are any ground rules governing 
the use of the school's lounge and parking lot. An observer 
should never abuse the privilege of using either one of the 
two areas mentioned above. If it is obvious that there is not 
enough room for the observer and the regular teachers to eat 
lunch during lunch period in the lounge, eat lunch in the car! 

• Introduce yourself to the teacher if possible before the 
beginning of class. Find out when and where the class will 
be going for that day. 

• Do not eat i drink or chew gum during an observation, nor use 
a noisy timepiece, such as a stop watch. 

• Try to avoid leaving the room' during an observation, unless 
it is unavoidable. 

• Avoid entering into arguments with the teacher or any other 
staff member of the school. 

• If a problem does arise when you are in the school, tell your 
supervisor about it as soon as you arrive back at the office. 
This will prepare him or her for handling any report the school 
might make. Also, this action fosters mutual trust and respect. 

Third Stage - Practice ! 

We have found it useful to spend about six hours, three at each session, view** 
ing videotapes of classroom instruction while coding our observation forms. 
Discussions following the sessions point out problems and allow for 
clarification. 

The observers were then sent to do pilot observations in real classrooms for a 
few hours each day, for a total of six days. (These practice sessions* unlike 
the actual observations, were prearranged with the principal and teacher.) 
After each observation, the observers would meet vith the supervisor in charge 
of their training and discuss any difficulties they had in using the form or 
making decisions. 

Frequent Teacher Reactions Encountered and How to Deal With Them. 



Once the observer begins actual observations, he or she can run into real 
problems in the form of teacher reaction to an observer in their classroom. 



82.39 



There are at least four teacher reactions that cau occur: 

• Hostility* This reaction usually occurs when the 
teacher has not been told of a possible visit by 
an outsider* 



• Apprehension* Young teachers or teachers new to 
the district usually display the most concern 
toward an observer* Teachers who are concerned 
about their personnel evaluations and poor classroom 
managers also show a great deal of apprehension about 
outside visitors* 

• Apathy* An attitude found in older teachers who 
are "marking time" until retirement, or who just 
are not aware of educational research* 

• At Ease* Teachers exhibiting this type of reaction 
are usually very confident of themselves and their 
abilities* They are completely at ease with the 
observer, friendly and courteous* 



With the exception of the last category, each of these attitudes can present 
problems for the observer* Here are a few strategies for dealing with them: 

• Hostility* Explain to the teacher at the earliest 
possible time why you are there* Make it plain you 
are not there to observe them or pass judgement on 
their job performance* Apologize on behalf of whoover 
should have informed them that they might be observed* 

• Apprehension* Listen to their concerns without 
letting them affect your objectivity* As with a 
hostile teacher, explain your reason 2ov being in 
the teacher's classroom, but do not divulge informa- 
tion to him or her that you should not and again make 
it plain that in no way are you there to pass judgement 
on their job perf onrance* 

• Apathy* In cases of this nature, all one can do is listen 
and give noncommittal responses; do the observation without 
favoritism or prejudice* 

Sometimes the atmosphere is so friendly and relaxed in the classroom, you may 
find yourself being drawn into a personal friendship with the teacher* Try to 
keep friendship and job responsibilities separate at all times* 

Frequent Student Reactions Encountered and How to Deal With Them* 



Students also react to the presence of an observer in their classroom* Most 
- students are curious and want to know why the observer is in their classroom* 
Others are completely at ease and go about their business with a friendly nod 
q of acknowledgement to the observer* The biggest problem occurs when you 
ERJjC encounter a showoff! £ 
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It is important that observers be unobtrusive, if they are to collect valid 
information about students 1 normal activities; therefore, the best way to deal 
with any situation which may invblve the students is to ask the teacher if he 
or she feels that the observer should be introduced to the whole class before 
classes begin* 

Ignore students who show off.' If their antics reach the point of interfering 
with your observation, quietly report the student to his/her teacher. 

o 

School Facilities or the Lack of Them. 

School facilities often cause problems for the classroom observer. Such 
problems include the lack of: adult-sized furniture, a place to eat your 
lunch, a chair and space to sic in the classroom, and finally, a parking space 
in the school's parking lot. Plan ahead! Although it is often not possible to 
change the conditions or facilities in which you will be observing, 
anticipation of the problem that might be encountered can be helpful. 

Designing Observation Instruments . 
Instruments used for observation should be: 

• Tailored to the age level of the students. (It is pointless 
to have a code for "recess 11 for hi$h school students, for 
example.) 

• Designed to answer specific questions, 
i Easy to use. 

During our eight-year history of observations, we have designed three 
instruments. The first instrument was called the Pupil Activity Record (PAR). 
The PAR is a systematic observation instrument designed to answer— "What is the 
amount and kind of instruction provided to elementary students during the 
instructional day? 11 One student is observed for an entire school day to 
provide the inferential measure of the instruction delivered to all students. 
The instrument also requires an ongoing record of the instructional materials 
used by the student. 

The variables observed with the PAR include the place of instruction, content 
area of instruction, mode of instruction, adult contact and the content of 
instruction. This form was printed on regular bond paper and. the information 
for each minute was keypunched. (The entire procedure was quite costly.) 

The second instrument was the Pupil Activity Record-Revised or PAR-R. In 
addition to PAR variables such as place and subject area of instruction, the 
PAR-R can be used to "record variables such as ethnicity of a student and 
whether a substitute teacher was present in the classroom. This instrument was 
printed with "OPSCAN", a scannable coding form. (The cost per sheet was three 
cents in 1980-81). 
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The third and most recent observation instrument designed by our office is a 
somewhat simplified systematic observation instrument designed to answer — 
"What is the amount and type of instruction provided to kindergarten students 
during a school day? 11 Two students from a class can be observed simultaneously 
for each minute during the eqtire school day. The variables recorded include 
adult contact, amount of instruction, instructional grouping, group size and 
off-task behavior. 

Originally, we used number two pencils for marking on the forma, but later 
switched to mechanical pencils with soft black lead. This eliminated constant 
pencil sharpening, and is still "scannable." 



SUMMARY 

We have used observations to gather a great deal of data -about students in our 
school district. We have shared our data, observation instruments and method 
of operation with many other school districts. 

A bibliography containing a number of reports whose findings were the results 
of observations has been included with this paper for your review. 
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Described how to use the PAR. 
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Part IX. ESEA Title I 

Part XII. State Compensatory Education 

PAR results are discussed in terms of programmatic impact 
for these two projects. 

Compensatory Programs Do Not Supplant, They Supplement, Right? Doss, D.A. 
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A technical report on the PAR-R is included. 
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observations using the PAR-R. 

Manual for the Pupil Activities Record for Principals 1 (PAR-P )• Doss, D. 
and Jackson, E. , 1980, AISD Pub. No. 80.46 
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designed to help principals focus their classroom observations 
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for Principals. 
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Ligon, 6. and 1 Doss, D., 1981, AISD Pub. No. 81.56 
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